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Abstract — The Mac Williams identity for linear time-invariant 
convolutional codes that has recently been found by Gluesing- 
Luerssen and Schneider is proved concisely, and generalized to 
arbitrary group codes on graphs. A similar development yields 
a short, transparent proof of the dual sum-product update rule. 



I. Introduction 

Finding a MacWilliams-type identity for convolutional 
codes is a problem of long standing. Recently Gluesing- 
Luerssen and Schneider (GLS) have formulated [1] and proved 
[2] such an identity involving the (Hamming) weight adja- 
cency matrix (WAM) of a linear time-invariant convolutional 
code over a finite field and the WAM of its orthogonal code. 

The purpose of this note is to provide a concise group- 
theoretic proof of this identity, and to generalize it to arbitrary 
group codes defined on graphs. We use first the general duality 
result that, given a "normal" graphical realization of a group 
code C, the dual (orthogonal) code C is realized by the 
dual graph, in which the "constraint code" corresponding to 
each node is replaced by its orthogonal code [3]. A more or 
less standard development (following [4]), using the Poisson 
summation formula, then proves an appropriate MacWilliams 
identity between the complete or Hamming WAM of a con- 
straint code and the complete or Hamming WAM of its dual. 

In the special case of a state-space (trellis) realization of 
a linear time-invariant convolutional code over a finite field, 
all constraint codes are identical, and our result reduces to 
the GLS result. Our formulation generalizes the GLS result 
to arbitrary group codes defined on graphs; e.g., linear time- 
varying convolutional codes, linear tail-biting codes, or trellis 
codes over finite abelian groups. 

We use a similar argument to provide a concise and trans- 
parent proof of the dual sum-product update rule stated in [3]. 

II. Codes, Realizations and Graphical Models 

We follow the development and notation of [3]. 

Let {Ak, k E I a} be a set of symbol variables Af. indexed 
by a discrete index set I4, where each At is a finite abelian 
group. We will mostly consider symbol variables Ak that are 
vector spaces over a finite field F, but all of our results and 
proofs generalize to arbitrary finite abelian groups. 

A group code C is a subgroup of the Cartesian-product 
group A = Hk£i A Ak- If A is actually a vector space over 
a finite field F, then a linear code C is a subspace of A. From 
now on, all codes will be assumed to be group or linear codes. 



A generalized state realization of a code C C A is defined 
by a set of state variables {Sj,j E 2s}, and a set of constraint 
codes {Ci, i E 2c}, where 2s and 2c are two further discrete 
index sets. Each state variable Sj is a finite group, or in the 
linear case a vector space over F. Each constraint code Ci is 
a group or linear code involving certain subsets of the symbol 
and state variables. The full behavior of the realization is 
the set 03 = (a, s) of all configurations of symbol variables 
a E A and state variables s £ S = Hj^j s Sj such that all 
constraints are satisfied. The code generated by the realization 
is the projection C = 03 1^ of 05 onto A; i.e., the set of all 
symbol configurations a E A that appear in some (a, s) E OS. 

For example, in a conventional state realization of a linear 
code C over a finite field F, the symbol index set Xa is a 
conventional discrete time axis, namely the set of integers Z, 
or a subinterval of Z. The state index set Is may be thought 
of as the set of times that occur between consecutive pairs of 
times in I4, and the state time preceding symbol time k E I a 
is conventionally also denoted by k E Tg. The constraint codes 
{Ck, k E I a} are linear codes indexed by the symbol index set 
Ta, and specify the set of all valid (sfc, ak, Sfc+i) transitions; 
i.e., for each k E Ta, Ck is a subspace of the Cartesian product 
vector space Sk x Ak x Sk+i- The full behavior 05 of the 
realization is the set of all symbol/state trajectories (a, s) such 
that (sk,ak, Sk+\) is a valid transition in Ck for all k E Ta- 
The code C generated by the realization is the set of all symbol 
trajectories a that appear in some (a, s) E 03. 

A normal realization is defined as a generalized state real- 
ization in which every symbol variable is involved in precisely 
one constraint code, and every state variable is involved in 
precisely two constraint codes. Thus a conventional state 
realization is normal. It is shown in [3] that any generalized 
state realization may be straightforwardly converted to a nor- 
mal realization by introducing replication constraints, without 
essentially increasing the complexity of the realization. 

A normal realization has a natural graphical model, in which 
each constraint code Ci corresponds to a vertex, each state 
variable Sj (which by definition is involved in two constraints) 
corresponds to an edge connecting the two corresponding 
constraint vertices, and each symbol variable Ak (which by 
definition is involved in one constraint) corresponds to a leaf or 
"half-edge" connected to the corresponding constraint vertex. 

For example, Figure 1 shows the graph corresponding to a 
conventional state realization, which is a simple chain graph. 
Here vertices are represented by square boxes, and the "half- 
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Fig. 1. Graph of a conventional state realization. 



Fig. 2. Graph of dual of a conventional state realization, with sign inverter. 



edges" corresponding to symbol variables are represented by 
special "dongle" symbols. 

III. Dual Normal Realizations 

The central duality result of [3] is the following: given a 
normal realization of a code C, the dual normal realization 
generates the dual code C-K For simplicity of exposition, we 
will explain this result only for the case where C is a linear 
code over a finite field F, but it holds also in the group case; see 
[3]. In the linear case, the dual code C is the usual orthogonal 
code to C under the usual symbolwise inner product. 

We have seen that a normal realization for C is defined by a 
set of symbol variables {Ak, k £ a set of state variables 
{Sj,j € 2s}, and a set of constraint codes {d, i G 2e}, where 
each symbol variable is involved in one constraint code, and 
each state variable is involved in two constraint codes. 

The definition of a dual normal realization is slightly simpler 
in the case of a linear code C over the binary field F2 than in 
the general case, so we discuss the binary case first. Then the 
dual normal realization is defined by the same sets of symbol 
and state variables, and by the set of orthogonal constraint 
codes {Cr-,i e 2^}, each involving the same variables as in 
the primal realization. The graph of the dual realization is 
thus the same as the graph of the primal realization, except 
that each constraint code C, is replaced by its orthogonal code 

Example 1. Consider the rate-1/2 binary linear time-invariant 
convolutional code C generated by the degree-2 generators (1+ 
D 2 , 1 + D + D 2 ), in standard D-transform notation. In other 
words, C is the set of all output sequences of the single-input, 
two-output linear time-invariant system over F2 whose impulse 
response is (11, 01, 11, 00, . . .). This system has a conventional 
four-state realization as in Figure 1 in which each symbol 
variable Ak may be taken as (F2) 2 , each state variable Sk may 
also be taken as (F2) 2 , and each constraint code Ck is the (6, 3) 
binary linear block code generated by the three generators 
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which represent the three nontrivial (state, symbol, next- 
state) transitions in the impulse response of the system. The 
orthogonal code C k may easily be seen to be the (6, 3) binary 
linear block code generated by the three generators 



which represent the three nontrivial (state, symbol, next-state) 
transitions in the impulse response of a system with impulse 
response (11, 10, 11, 00, . . .), or (1 + D + D 2 , 1 + D 2 ) in D- 
transform notation. This is indeed the generator of the orthog- 
onal convolutional code C under the symbolwise definition 
of the inner product that we are using here. (For the more 
usual sequencewise definition of the inner product, we need 
to take the time-reversal of (XQ which in this case is again 
the code generated by (1 + D + D 2 , 1 + D 2 ). □ 

For a linear code C over a nonbinary field F, one further 
trick (originally introduced by Mittelholzer [6] to dualize 
conventional state realizations over groups) is needed to define 
the dual normal realization: namely, in terms of the graph of 
the realization, insert a sign inverter in the middle of every 
edge. In other words, invert the sign of each state variable Sf. 
in one of the two constraint codes in which it is involved. This 
is illustrated in Figure 2 for a conventional state realization. 

Example 2 (cf. [1], [2]). Consider the rate-2/3 linear time- 
invariant convolutional code C over F3 with gi(D) = (1 + 
D 2 ,2 + D,0) and g 2 (D) = (1,0,2). In other words, C is the 
set of all output sequences of the two-input, three-output linear 
time-invariant system over F3 whose impulse responses are 
(120, 010, 100, 000, . . .) and (102, 000, . . .). This system has 
a conventional nine-state realization as in Figure 1 in which 
each symbol variable Ak may be taken as (F3) 3 , each state 
variable Sk may be taken as (F3) 2 , and each constraint code 
Ck is the (7, 4) ternary linear block code generated by the four 
generators 
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which represent the four nontrivial (su, (Xfc, s*;+i) transitions 
in the two impulse responses of the system. The orthogonal 
code C k is the (7,3) ternary linear block code generated by 
the three generators 
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which represent the three nontrivial (s' k , a' k , ~s' k+1 ) transitions 

'The symbolwise inner product of two sequences a, b 6 A is ~}2 k ifcbfc, 
and that of a and a shift of b by j time units is a k b k _j. The product 
of the corresponding D-transforms a(D) = a k D k and b(D~ 1 ) = 
^2 k b k D~ k is -(5Zfe a k^k— • s0 a i s orthogonal to all shifts of b 
if and only if a(D)b(D~ 1 ) = 0, or equivalently if a(D)b(D) = 0, where 
b(D) is the D-transform of the time-reversed sequence b = {6_fe, k G Ia\- 



in the impulse response of a conventional state realization 
of a single-input, three-output linear system over F 3 , with 
sign inverters as in Figure 2, whose impulse response is 
(010, 202, 111, 000, . . .), or (2D+D 2 , 1+L> 2 , 2D+D 2 ) in D- 
transform notation. (Note the unconventional basis of the dual 
state space.) This is indeed the generator of the orthogonal 
convolutional code C 1 - under our symbolwise definition of the 
inner product. (For the more usual sequence-wise definition 
of the inner product, we need to take the time-reversal of C^, 
which in this case is the code generated by (1 + 2D, 1+D 2 , 1 + 
2D).) " □ 

IV. MacWilliams Identities 

Given these duality results, various Mac Williams-type iden- 
tities may be obtained in a more or less standard manner. We 
follow the development in [4]. 

Every finite abelian group T is a direct product of cyclic 
groups. In particular, every finite field F has q = p m elements 
for some prime p and is isomorphic as an additive group 
to (Z p ) m , and every vector space over a finite field ¥ pm of 
dimension d is isomorphic to (Z p ) md . Thus, for some integer 
n, we may take T = (Z p ) n , the set of n-tuples of elements 
of Z p . 

Given a complex-valued function {x : T — > C,t i— > x(t)} 
defined on T = (Z p )™, its (Fourier) transform is the complex- 
valued function {A" : T — > C, f ^ X(f)} defined on T = 

(Zp) n by 

X{f) = ^x(t)uf-\ f £ T , 

T 

where u> is a primitive complex pth root of unity, and f-t £ Z p 
is the ordinary dot product between the n-tuples / £ (Z p )™ 
and t £ (Z p )™ over Z p . If we view x = {x(t),t 6 T} as a 
vector indexed by T, and similarly X = {X(f), f £ T} as a 
vector indexed by T, then the transform can be expressed in 
matrix form as 

X = Wx, 

where the transform matrix is TL = {u^' l ,f £ T,t £ T}. 
Note that TL T = TL, where TL T denotes the transpose of TL. 
From the orthogonality relation 



m 

0, 



t = 0; 
t?0, 



we obtain the matrix equation 



TLTL* = 

where TL* = {w~ f -\f E T,t E T}, \T\ = \T\ = p n , 
and Lj7i is the \T\ x \T\ identity matrix. In other words, the 
inverse of TL is TL^ 1 = |JF| -I 7i*. Thus we obtain the inverse 
transform 

TL*X 



We may extend these definitions to a set of indeterminates 
z = {z(t),t £ T} indexed by T, rather than a complex- 
valued function. The transform of this set is then a set of 
indeterminates Z = {Z(f), f £ T} indexed by T, where 

Z = Hz. 

Again, we have the inverse transform relationship 



z = «- i Z 



TL*Z 

"FT' 



and we say that z and Z are a transform pair. 

For example, if T = Z 2) then Z(0) = z(0) + z(l) and 
Z(l) = z{0) - z(l); similarly, z(0) = \{Z{0) + Z{1)), and 
z(l) = i(Z(0)-Z(l)). 

Now let us consider weight enumerators, initially for the 
case of a conventional state realization over a finite field F as 
in Figure 1. We define the complete weight adjacency matrix 
(CWAM) of each constraint code Cfe C Sk x x Sk+i as 
follows. 

If Ak — F", then define the complete weight enumerator 
of the n-tuple a = (a\,...,a n £ F") as the product 
w(a) = Ui<i< n w(ai), where w = {w(a),a £ F} is a set 
of indeterminates indexed by F. Then the CWAM of Ck is the 
matrix A(w) = {A(s fc , s fc+ i)(w), (s k , s k+1 ) £ S k x S k+1 } 
defined by 



A(sfc, Sfe+i)(w) 



w(a fe ), 

C(s k ,s k + 1 ) 



We say that x and X are a transform pair. 



where C(s k ,s k+1 ) = {a fe | (s k ,a k ,s k+ i) £ C k }. Thus each 
entry A(s k , s k+ i)(w) is a homogeneous integer polynomial 
of degree n in the |F| indeterminates w = {w(a), a £ ¥}. 

Now let y = {y(s k ),s k £ S k } and z = {z(s k+1 ), s k+1 £ 
S k +i} be sets of indeterminates indexed by the state variables 
S k and Sfc+i, respectively, and define a generating function 
<?A(w)(y, z X a polynomial in the sets of indeterminates y and 
z, as follows: 

.9A(w)(y,z) = y T A(w)z 

= £ y(sk)Hs k ,s k+1 )(w)z(s k+1 ). 

SkX-Sk+i 

From the definition C(s k , s k+1 ) = {& k \ (s k , a k ,s k+1 ) £ C k }, 
it follows that 

5A(w)(y,z)= y(s k )w(a k )z(s k+1 ). 

(s k ,a. k ,s k + 1 )eC k 

Example 1 (cont.). The constraint code of Example 
1 has the eight codewords 00 00|00, 00|11 10, 10|01|01, 
10|10|11,01|11|00,01|00|10,11|10|01,11|01|11, correspond- 
ing to the eight possible (state, symbol, next-state) transitions. 
Writing {u>o,wi} instead of {w(0),w(l)}, we see that we 
may write the CWAM of this constraint code in matrix form 



as 



A(w) = 
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Equivalently, its generating function <7a(w) (y, z ) is 

5A(w)(y,z) = w%(y 00 z 00 + y 01 z 10 ) + wl(y 00 z 10 + y 10 z 00 ) 
+ WQvmiyoiZoi + yaizn + ynz Q1 + ynzn). 

□ 

The key duality relation for MacWilliams identities is the 
Poisson summation formula, which says that "the sum of a 
function over a linear space is equal to the sum of the Fourier 
transform of the function over the dual space" [5]. For our 
case, this formula may be stated as follows: 

Poisson summation formula. Let x and X be a transform pair 
defined on T = (Z p )™ and T — (Z p ) n , respectively, and let 
C and C 1 - be orthogonal subgroups of T and T, respectively. 
Then 

£*(*)=i^ £*(/)• 

tec 1 1 fec x 

Now, applying this formula to the equation above for 
5A(w)(y,z), we obtain 

5A(w)(y,z) = ^2y(s k )w(a k )z(s k+1 ) 

c k 

Here we use the fact that the transform of a product is the 
product of their transforms, where Y = 7i y y, W = H w w, 
and Z = H z z. Note that W is itself a product transform. 
Also, since the elements of H z are H z (sk+i, —Sk+i) = 
£j -a *+i •**+!, the matrix H z is the conjugate of the usual 
transform matrix over Sk+i- 

If we define the CWAM A(W) of C^r and its generating 
function g^(w) O^j Z ) similarly to the analogous quantities for 
Ck, then we obtain 

3A(W) (Y,Z) =^r(s fc )^(a fe )Z(-s fc+1 ). 

Using inverse transforms, we thus obtain 

5a(w)( Y > Z ) = l C fc1.9A(w)(y,z) 

= \ C k IffACW^W)^* Y '^J 1Z )- 

This MacWilliams identity shows how the generating function 
for the CWAM A(W) of may be obtained from that for 
Ck, or vice versa. 
Alternatively, since 

5A(W) (Y,Z)=Y T A(W)Z 



and 

5A ( w)(y,z) = y T A(w)z = Y T n- 1 K{n- 1 w)n- z 1 z, 

we may simply write 

A(w) = ictin-'Ain-^n- 1 , 

a MacWilliams identity that shows how the CWAM of C£ 
may be obtained from the CWAM of Ck- 

Example 1 (cont.). Given the CWAM A(w) of the constraint 
code C k of Example 1, the CWAM A(W) of the orthogonal 
constraint code C^ is given by the matrix equation at the 
top of the next page, where we have substituted the dual 
indeterminates Wq and W\ for wo + wi and wq — w\. □ 

The Hamming weight adjacency matrix (HWAM) Ah of a 
constraint code Ck is obtained by substituting 1 for w(Q) and 
w for each w(a), a^0. Thus each element A#(s/-, Sk+i){w) 
becomes a polynomial of degree n in the single indeterminate 
w. The dual indeterminates become W(0) = 1 + (|F| — l)w 
and W(a) = 1 — w, a ^ 0, which scale to 1 and W — 
(1 — w)/(l + (|F| — l)w), respectively. Substituting in the 
above MacWilliams-type identities for CWAMs, we obtain 
Mac Williams-type identities for HWAMs. This yields the main 
result of [1], [2]0 

Example 2 (cont.)- For a worked-out example of the HWAM 
A(VK) of the orthogonal code C^r to the constraint code of 
Example 2, see [2]. □ 

Although our development has focussed on conventional 
state realizations of linear time-invariant convolutional codes, 
it may be straightforwardly extended to obtain MacWilliams 
identities for any generalized state realization of any finite 
abelian group code defined on an arbitrary graph, because 
constraint code duality holds in the general case. 

V. Dualizing the Sum-Product Update Rule 

Another duality result in [3] is a general method for dual- 
izing the sum-product update rule, which among other things 
yields the "tanh rule" of APP decoding. The approach of this 
paper yields a cleaner derivation of this result. 

Again, for simplicity we restrict attention to conventional 
state realizations, in which each constraint code Ck specifies 
the state transitions in Sjxitx Sk+i that can possibly occur. 
Let the (right-going) message be any real- or complex-valued 
function = {mk(sk), Sk £ Sk} of the state variable Sk, 
and let = {fk(a-k), ik S Ak] be any real-or complex- 
valued weight function of the symbol variable Ak- Then the 
sum-product update rule associated with constraint code Ck is 

m k+ i(sk+i) = 2J m k (sk)fk(ak), 

Cfc(s fc + i) 

2 The MacWilliams identity of [1], [2] is stated in terms of the HWAM 
for a minimal realization of a linear time-invariant convolutional code C in 
controller canonical form, and the HWAM of some minimal encoder for the 
orthogonal code C . Our results apply to the CWAM or HWAM of any state 
realization, and the CWAM or HWAM of its dual realization, because in our 
development, by constraint code duality, the basis of the dual state space 
representation is fixed as soon as the basis of the primal state space is fixed. 
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where C k (s k+1 ) = {(s fc ,a fe ) S 5 fe x A fe | (s fc , a fe , s fc+ i) G 
Cfe}. In other words, if we define a set of indeterminates 
x = {x(s k +i), s k +i € Sfc+i}, then m fe+ i(s fc+ i) is the coef- 
ficient of x(sk+i) in the homogeneous degree-1 multivariate 
generating function g k+ i(x) defined by 

3fe+i(x) = m^ +1 x = m k+1 (s k+1 )x{s k+1 ). 

Sk + l 

From the definition of C k (s k +i), it follows that 

fffe+l(x) = ^ m k (s k )f k (a k )x(s k+1 ). 
c k 

Using the Poisson summation formula, we obtain 

g fc+ i(x) = ^ m k (s k )f k (a k )x{s k+1 ) 

gfc+i(X) 

\ci\ ' 

where we again use the fact that the transform of a product 
is the product of their transforms, and define transformed 
functions or indeterminates by corresponding capitalized func- 
tions or indeterminates. The left side of this equation is the 
generating function g k+ i{x) of the message {m k+ i}, and the 
right side is (up to scale) the generating function g k +x(X.) of 
the message Mfc + i obtained by performing the sum-product 
update algorithm for C^r upon the message and the weight 
function F k . Moreover, the messages m k+ i and Mfe + i form 
a transform pair. 

Consequently, we have the following recipe for performing 
the sum-product update rule for C k : 

1) Transform the incoming messages m k and to M. k 
and F fe ; 

2) Perform the sum-product update rule for to generate 
an output message Mfe+i; 

3) Inverse transform Mfe+i to obtain the message nifc+i, 
up to the scale factor \C k L \. 

Since the complexity of performing the sum-product update 
rule for C k is proportional to \C k \, this dual computation may 
be attractive if \C^\ < \C k \. 



Example 3 ("tanh rule")- Let S k ,A k and S k+1 be bi- 
nary variables taking values in F2, and let C k be the (3, 2) 
single-parity-check code consisting of the four codewords 
(000,011,101,110); then is the (3,1) repetition code 
consisting of the two codewords (000, 111). Let the incoming 
message and weight function be m^, = (mo, mi) and = 
(/o,/i); then the transformed message and weight function 
are = (M$ = m + mi, Mi = m — mi) and F k = 
(Fo = fo + fi,Fi = /o -/l). Using two multiplications, 
the sum-product update equation then produces the message 
M k+1 = (M fc+ i(Q) = (m +mi)(/ + /i),Affc+i(l) = 
(mo — mi)(/o — /1)). Thus, up to scale, the message mfc + i 
is 

m fe+ i(0) = M fe+ i(0) + M k+ i(l) cx m / + mi/i; 
m fe+ i(l) = M fc+ i(0) -M fe+ i(l) ocmo/i + mi/o; 

which is evidently the message that would have been computed 
by a direct computation of the sum-product update rule for C k , 
which requires four multiplications. □ 

Again, although our development has focussed on a con- 
straint code of a conventional linear state realization, it may 
be straightforwardly extended to obtain a dual sum-product 
update rule for an arbitrary constraint code over any finite 
abelian group. 
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